Theory and Applications of 
N-Fold Integer Programming 
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Abstract 

We overview our recently introduced theory of n-fold integer programming 
which enables the polynomial time solution of fundamental linear and nonlin- 
ear integer programming problems in variable dimension. We demonstrate its 
power by obtaining the first polynomial time algorithms in several application 
areas including multicommodity flows and privacy in statistical databases. 



1 Introduction 

Linear integer programming is the following fundamental optimization problem, 

min {wx : iGZ", Ax = b , I < x < u} , 

where A is an integer m x n matrix, b e Z m , and !,«£ with := Z l±l {±00}. 
It is generally NP-hard, but polynomial time solvable in two fundamental situations: 
the dimension is fixed [18]; the underlying matrix is totally unimodular [15]. 

Recently, in [4], a new fundamental polynomial time solvable situation was dis- 
covered. We proceed to describe this class of so-termed n-fold integer programs. 

An (r, s) x t bimatrix is a matrix A consisting of two blocks Ai, A 2 , with A\ its 
r x t submatrix consisting of the first r rows and A 2 its s x t submatrix consisting 
of the last s rows. The n-fold product of A is the following (r + ns) x nt matrix, 



A (n) 



(A, 
A 2 




A l 


A 2 



A. \ 





\ ••• A 2 ) 
The following result of [4] asserts that n-fold integer programs are efficiently solvable. 



'Supported in part by a grant from ISF - the Israel Science Foundation 



1 



2 



N-Fold Integer Programming 



Theorem 1.1 [4] For each fixed integer (r, s) x t bimatrix A, there is an algorithm 
that, given positive integer n, bounds l,u G Z^; 7 b G Z r+ns 7 and u> G Z n * ; solves in 
time which is polynomial in n and in the binary- encoding length (l,u,b,w) of the 
rest of the data, the following so-termed linear n-fold integer programming problem, 

min {wx : x <E Z nt , A {n) x = b, I <x <u] . 

Some explanatory notes are in order. First, the dimension of an n-fold integer 
program is nt and is variable. Second, n-fold products are highly non totally 
unimodular: the n-fold product of the simple (0, 1) x 1 bimatrix with A 1 empty and 
A2 : = 2 satisfies A^ = 2I n and has exponential determinant 2™. So this is indeed a 
class of programs which cannot be solved by methods of fixed dimension or totally 
unimodular matrices. Third, this class of programs turns out to be very natural 
and has numerous applications, the most generic being to integer optimization over 
multidimensional tables (see §2). In fact it is universal: the results of [7] imply that 
every integer program is an n-fold program over some simple bimatrix A (see §4). 

The above theorem extends to n-fold integer programming with nonlinear ob- 
jective functions as well. The following results, from [12], [5] and [13], assert that 
the minimization and maximization of broad classes of convex functions over n-fold 
integer programs can also be done in polynomial time. The function / is presented 
either by a comparison oracle that for any two vectors x, y can answer whether or 
not f(x) < f(y), or by an evaluation oracle that for any vector x can return f(x). 

In the next theorem, / is separable convex, namely f(x) = J2i fi( x i) with each fa 
univariate convex. Like linear forms, such functions can be minimized over totally 
unimodular programs [14]. We show that they can also be efficiently minimized 
over n-fold programs. The running time depends also on log / with / the maximum 
value of \f(x)\ over the feasible set (which need not be part of the input). 

Theorem 1.2 [12] For each fixed integer (r, s) X t bimatrix A, there is an algorithm 
that, given n, l,u G ZJ^ 7 b G Z r+ns 7 and separable convex f : Z n * — > Z presented by 
a comparison oracle, solves in time polynomial in n and (l,u,b,f), the program 

mm{f(x) : x G Z n< , A {n) x = b, I <x <u] . 

An important natural special case of Theorem 1.2 is the following result that 
concerns finding a feasible point which is /^-closest to a given desired goal point. 

Theorem 1.3 [12] For each fixed integer (r, s) x t bimatrix A, there is an algorithm 
that, given positive integers n and p, l,u G Z^ 7 b G Z r+ns , and x G Z™* 7 solves in 
time polynomial in n, p, and (I, u, b, x) , the following distance minimization program, 

min{||a:-x||p : x G Z n *, A {n) x = b, I < x < u] . (1) 

For p = 00 the problem (1) can be solved in time polynomial in n and (l,u,b,x). 
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The next result concerns the maximization of a convex function of the composite 
form f(Wx), with / : Z d — > Z convex and an integer matrix with d rows. 

Theorem 1.4 [5] For each fixed d and (r,s) x t integer bimatrix A, there is an 
algorithm that, given n, bounds l,u G ZJ^ ; integer d x nt matrix W, b G Z r+ns , 
and convex function f : Z d — > K. presented by a comparison oracle, solves in time 
polynomial in n and (W,l,u,b), the convex n-fold integer maximization program 

max{f(Wx) : xeZ nt , A {n) x = b, I < x < u} . 



Finally, we have the following broad extension of Theorem 1.2 where the objective 
can include a composite term f(Wx), with / : Z d — > Z separable convex and an 
integer matrix with d rows, and where also inequalities on Wx can be included. As 
before, f,g denote the maximum values of \g(x)\ over the feasible set. 

Theorem 1.5 [13] For each fixed integer (r, s) x t bimatrix A and integer (p, q) xt 
bimatrix W , there is an algorithm that, given n, l,u G Z^ 7 l,u £ Z^J"™ 13 , b G Z r+riS 7 
and separable convex functions f : Z p+nq — > Z ; : Z n * — > Z presented by evaluation 
oracles, solves in time polynomial in n and (I, u, I, u, b, f, g) , the generalized program 



mm 



{f(W {n) x) + g(x) : x G Z nt , A^'x = b , Z < W" (n) a; < u , I < x < m} 



The article is organized as follows. In Section 2 we discuss some of the many 
applications of this theory and use Theorems 1.1-1.5 to obtain the first polynomial 
time algorithms for these applications. In Section 3 we provide a concise develop- 
ment of the theory of n-fold integer programming and prove our Theorems 1.1-1.5. 
Sections 2 and 3 can be read in any order. We conclude in Section 4 with a discussion 
of the universality of n-fold integer programming and of a new (di)-graph invariant, 
about which very little is known, that is important in understanding the complex- 
ity of our algorithms. Further discussion of n-fold integer programming within the 
broader context of nonlinear discrete optimization can be found in [21] and [22]. 



2 Applications 

2.1 Multiway Tables 

Multiway tables occur naturally in any context involving multiply-indexed vari- 
ables. They have been studied extensively in mathematical programming in the 
context of high dimensional transportation problems (see [27, 28] and the references 
therein) and in statistics in the context of disclosure control and privacy in statistical 



4 



N-Fold Integer Programming 



databases (see [3, 9] and the references therein). The theory of n-fold integer pro- 
gramming provides the first polynomial time algorithms for multiway table problems 
in these two contexts, which are discussed in §2.1.1 and §2.1.2 respectively. 

We start with some terminology and background that will be used in the sequel. 
A d-way table is an mi x • • • x array x = (xi u ,„ t i d ) of nonnegative integers. A 
d-way transportation polytope (d-way polytope for brevity) is the set of m\ x • • • x m^ 
nonnegative arrays x = (x^,...,^) with specified sums of entries over some of their 
lower dimensional subarrays (margins in statistics). The d-way tables with specified 
margins are the integer points in the ci-way polytope. For example (see Figure 1), 
the 3-way polytope oflxmxn arrays with specified line-sums (2-margins) is 




where the specified line-sums are mn + In + Im given nonnegative integer numbers 

v*,j,k , ^,*,fe , , 1 <i<l, 1 <j <m, 1 <k <n . 

Our results hold for /c-margins for any < k < d, and much more generally for any 
so-called hierarchical family of margins. For simplicity of the exposition, however, 
we restrict attention here to line-sums, that is, (d — l)-margins, only. 

We conclude this preparation with the universality theorem for multiway tables 
and polytopes. It provides a powerful tool in establishing the presumable limits of 
polynomial time solvability of table problems, and will be used in §2.1.1 and §2.1.2 to 
contrast the polynomial time solvability attainable by n-fold integer programming. 

Theorem 2.1 [7] Every rational polytope P = {y e R+ : Ay = b} is in polynomial 
time computable integer preserving bijection with some I x m x 3 line-sum polytope 




2.1.1 Multi-index transportation problems 

The multi-index transportation problem of Motzkin [19] is the integer programming 
problem over multiway tables with specified margins. For line-sums it is the program 

{C ^7 m l x '" xm d . \ \ r I 

wx : X fc /L+ : ^ , x h,...,id ~ v *,i2, —iid ) ••• ) / j x h,...,id — v h,...,id-i,* f 

h id J 

For d = 2 this program is totally unimodular and can be solved in polynomial time. 
However, already for d — 3 it is generally not, and the problem is much harder. 
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Multiway Tables 

Consider m 1 x ■ ■ ■ x m d x n tables with given margins such as line-sums: 




Such tables form an n-fold program {x : A (n 'x = b, x > 0, x integer} for 
suitable bimatrix A determined by m 1 , . . . , m d where A 1 controls equations 
of margins which involve summation over layers, whereas A 2 controls 
equations of margins involving summation within a single layer at a time 



Figure 1: Multiway Tables 

Consider the problem over I x m x n tables. If l,m,n are all fixed then the problem 
is solvable in polynomial time (in the natural binary-encoding length of the line- 
sums), but even in this very restricted situation one needs off-hand the algorithm 
of integer programming in fixed dimension Imn. If l,m,n are all variable then the 
problem is NP-hard [17]. The in-between cases are much more delicate and were 
resolved only recently. If two sides are variable and one is fixed then the problem 
is still NP-hard [6]; moreover, Theorem 2.1 implies that it is NP-hard even over 
I x m x 3 tables with fixed n = 3. Finally, if two sides are fixed and one is variable, 
then the problem can be solved in polynomial time by n-fold integer programming. 
Note that even over 3x3xn tables, the only solution of the problem available 
to-date is the one given below using n-fold integer programming. 

The polynomial time solvability of the multi-index transportation problem when 
one side is variable and the others are fixed extends to any dimension d. We have 
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the following important result on the multi-index transportation problem. 

Theorem 2.2 [4] For every fixed d, mi, . . . , rrid, there is an algorithm that, given n, 
integer mix- ■ -xm^xn costw, and integer line-sums v = ((v*,i 2 ,...,i d+1 ), ■ ■ ■ , (fii,...,i d ,*)), 
solves in time polynomial in n and (w,v), the (d + 1) -index transportation problem 



_ rymiX-xm,jXn . \ ^ _ \ ^ _ 

mm < WX . X fc /L + . ^ %h,...,i d+1 — v *,i2,...,id+n ■ ■ ■ i / u x h,...,i d +i ~ v ii,—,id, 

h id+i 

Proof. Re-index arrays as x = (x 1 , . . . , x n ) with each x ld+1 = {xi 1 ^,,^ d ^ d+1 ) a suitably 
indexed m\m,i ■ ■ ■ vector representing the i^+i-th layer of x. Similarly re-index 
the array w. Let t :— r :— m\m2 ■ ■ • rrid and s := n (m 2 • • • + • • • + mi • • • m^_i). 
Let b := (b°, b 1 ,..., b n ) e Z r+ns , where b° := K,..., id ,*) and for i d+1 = 1, . . . , n, 

b d+1 := {( V *,i2,~-,id,id+i)i ■ ■ ■ ' ( v h,-.,id-i,*,id+i)) ■ 

Let A be the (t, s) x t bimatrix with first block A\ := I t the t x t identity matrix 
and second block A 2 a matrix defining the line-sum equations on mi x • • • x m d 
arrays. Then the equations ^4i(^ id+1 x ld+1 ) = b° represent the line-sum equations 
.,i d +i — v h,...,i d ,* where summations over layers occur, whereas the equa- 
tions A 2 x ld+1 = b ld+1 for id+i = l,...,n represent all other line-sum equations, 
where summations are within a single layer at a time. Therefore the multi-index 
transportation problem is encoded as the n-fold integer programming problem 

min{wx : x G Z nt , A (n) x = b, x > 0} . 

Using the algorithm of Theorem 1.1, this n-fold integer program, and hence the 
given multi-index transportation problem, can be solved in polynomial time. □ 

This proof extends immediately to multi-index transportation problems with 
nonlinear objective functions of the forms in Theorems 1.2-1.5. Moreover, as men- 
tioned before, a similar proof shows that multi-index transportation problems with 
/c-margin constraints, and more generally, hierarchical margin constraints, can be 
encoded as n-fold integer programming problems as well. We state this as a corollary. 



Corollary 2.3 [5] For every fixed d and mi, . . . ,m,d, the nonlinear multi-index 
transportation problem, with any hierarchical margin constraints, over (d + l)-way 
tables of format mi x • • • x m d x n with variable n layers, are polynomial time solvable. 
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2.1.2 Privacy in statistical databases 

A common practice in the disclosure of sensitive data contained in a multiway table 
is to release some of the table margins rather than the entries of the table. Once 
the margins are released, the security of any specific entry of the table is related 
to the set of possible values that can occur in that entry in all tables having the 
same margins as those of the source table in the database. In particular, if this set 
consists of a unique value, that of the source table, then this entry can be exposed 
and privacy can be violated. This raises the following fundamental problem. 

Entry uniqueness problem: Given hierarchical margin family and entry index, 
is the value which can occur in that entry in all tables with these margins, unique? 

The complexity of this problem turns out to behave in analogy to the complexity of 
the multi-index transportation problem discussed in §2.1.1. Consider the problem 
for d = 3 over I x m x n tables. It is polynomial time decidable when I, m, n are all 
fixed, and coNP-complete when /, m, n are all variable [17]. We discuss next in more 
detail the in-between cases which are more delicate and were settled only recently. 

If two sides are variable and one is fixed then the problem is still coNP-complete, 
even over / x m x 3 tables with fixed n = 3 [20]. Moreover, Theorem 2.1 implies 
that any set of nonnegative integers is the set of values of an entry of some / x m x 3 
tables with some specified line-sums. Figure 2 gives an example of line-sums for 
6x4x3 tables where one entry attains the set of values {0, 2} which has a gap. 

Theorem 2.4 [8] For every finite set S C Z + of nonnegative integers, there exist 
l,m, and line-sums for I x m x 3 tables, such that the set of values that occur in 
some fixed entry in all I x m x 3 tables that have these line-sums, is precisely S. 

Proof Consider any finite set S = {s±, . . . , Sh} C Z + . Consider the polytope 

h h 
P := {yeR h + +1 : y -X>%- = 0, J> = 1} • 

3=1 3=1 

By Theorem 2.1, there are l,m, and I x m x 3 polytope T with line-sums 

v*,j,k , Vi^ k , v^* , 1 <i<l, 1 < j < m , 1<£;<3 , 

such that the integer points in T, which are precisely the !xmx3 tables with these 
line-sums, are in bijection with the integer points in P. Moreover (see [7]), this 
bijection is obtained by a simple projection from ]R /Xmx3 to R h+1 that erases all but 
some h + 1 coordinates. Let be the coordinate that is mapped to y . Then the 
set of values that this entry attains in all tables with these line-sums is, as desired, 

{x hJ , k : xeTDZ 1 *" 1 * 3 } = {y : yePnz h+1 } = S. □ 
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Set of Entry Values With a Gap 

The only values occurring in the designated entry in all 
6x4x3 tables with the specified line-sums are 0, 2 




Figure 2: Set of Entry Values With a Gap 

Finally, if two sides are fixed and one is variable, then entry uniqueness can be 
decided in polynomial time by ra-fold integer programming. Note that even over 
3 x 3 x n tables, the only solution of the problem available to-date is the one below. 

The polynomial time decidability of the problem when one side is variable and 
the others are fixed extends to any dimension d. It also extends to any hierarchical 
family of margins, but for simplicity we state it only for line-sums, as follows. 



Theorem 2.5 [20] For every fixed d, mi, . . . , m^, there is an algorithm that, given 
n, integer line-sums v = ((f*,^,...,;^), . . . , (%,...,i d ,*)) ; an d entry index (k\, . . . , kd+i), 
solves in time which is polynomial in n and (v), the corresponding entry uniqueness 



Shmuel Onn 



9 



problem, of deciding if the entry Xk u ...,k d+1 is the same in all (d+ 1) -tables in the set 

q — J p ymix-xm d xti . . _ . V^r- - ?>■ 

^ u *d+i 

Proof. By Theorem 2.2 we can solve in polynomial time both ra-fold programs 

I := min {x fcl) ... )fc<J+1 : x G 5} , 

« := max{x fcli ... )fed+1 : iGS} . 

Clearly, entry ajfc 1 ... i fc d+1 has the same value in all tables with the given line-sums if 
and only if I — u, which can therefore be tested in polynomial time. □ 

The algorithm of Theorem 2.5 and its extension to any family of hierarchical mar- 
gins allow statistical agencies to efficiently check possible margins before disclosure: 
if an entry value is not unique then disclosure may be assumed secure, whereas if the 
value is unique then disclosure may be risky and fewer margins should be released. 

We note that long tables, with one side much larger than the others, often arise 
in practical applications. For instance, in health statistical tables, the long factor 
may be the age of an individual, whereas other factors may be binary (yes-no) 
or ternary (subnormal, normal, and supnormal). Moreover, it is always possible 
to merge categories of factors, with the resulting coarser tables approximating the 
original ones, making the algorithm of Theorem 2.5 applicable. 

Finally, we describe a procedure based on a suitable adaptation of the algorithm 
of Theorem 2.5, that constructs the entire set of values that can occur in a specified 
entry, rather than just decides its uniqueness. Here S is the set of tables satisfying 
the given (hierarchical) margins, and the running time is output-sensitive, that is, 
polynomial in the input encoding plus the number of elements in the output set. 

Procedure for constructing the set of values in an entry: 

1. Initialize I := — oo, u := oo, and E := 0. 

2. Solve in polynomial time the following linear n-fold integer programs: 

1 := min {x ku ..., kd+1 : / < x ku ... tkd+1 < it, x € S} , 
u := max {x kl ,...,k d+1 ■ I < x ku ..., kd+1 < u , x E S} . 

3. If the problems in Step 2 are feasible then update I :— I + 1, u :— u — 1, 
E := E l±l {l,u}, and repeat Step 2, else stop and output the set of values E. 
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2.2 Multicommodity Flows 

The multicommodity transshipment problem is a very general flow problem which 
seeks minimum cost routing of several discrete commodities over a digraph subject 
to vertex demand and edge capacity constraints. The data for the problem is as 
follows (see Figure 3 for a small example). There is a digraph G with s vertices 



Multicommodity Transshipment Example 

Data: 

digraph G 

two commodities: red and green 
edge capacities u e ulimited 

edge costs f e (x 1 e +x 2 e ):=(x 1 e +x 2 e ) 2 and g 1 e (x 1 e ):=g 2 e (x 2 e ):=0 
vertex demands: 

d 1 := (3 -1 -2) 

d 2 :=(-3 2 1) 

Solution: 

X 1 = (3 2 0) 
X 2 = (0 2 3) 

Cost: 

(3+0) 2 +(2+2) 2 +(0+3) 2 = 34 




Figure 3: Multicommodity Transshipment Example 

and t edges. There are I types of commodities. Each commodity has a demand 
vector d k G Z s with d k the demand for commodity k at vertex v (interpreted as 
supply when positive and consumption when negative). Each edge e has a capacity 
u e (upper bound on the combined flow of all commodities on it). A multicommodity 
transshipment is a vector x = (x 1 , ... ,x ) with x k G for all k and x\ the flow of 
commodity k on edge e, satisfying the capacity constraint Y^k=i x e — u e f° r each 
edge e and demand constraint ^2 ee s+( v ) x e ~ J2 e es-(v) x e = d% for each vertex v and 
commodity k (with 5 + {y ), S~(v) the sets of edges entering and leaving vertex v). 
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The cost of transshipment x is defined as follows. There are cost functions 
f e ,g^:Z^Z for each edge and each edge-commodity pair. The transshipment 
cost on edge e is f e (52k=i x e) + Si=i 9e( x e) wr th the first term being the value of 
f e on the combined flow of all commodities on e and the second term being the sum 
of costs that depend on both the edge and the commodity. The total cost is 

e=l \ \fe=l / k=l / 

Our results apply to cost functions which can be standard linear or convex such 
as a e \ Y^k=i x e + Sl=i 7e \ x e I" 5 * f° r some nonnegative integers a e , (3 e , 7^ , 5^ , which 
take into account the increase in cost due to channel congestion when subject to 
heavy traffic or communication load (with the linear case obtained by f3 e = 5^=1). 

The theory of n-fold integer programming provides the first polynomial time 
algorithms for the problem in two broad situations discussed in §2.2.1 and §2.2.2. 

2.2.1 The many-commodity transshipment problem 

Here we consider the problem with variable number / of commodities over a fixed 
(but arbitrary) digraph - the so termed many-commodity transshipment problem. 
This problem may seem at first very restricted: however, even deciding if a feasible 
many-transshipment exists (regardless of its cost) is NP-complete already over the 
complete bipartite digraphs K 3>n (oriented from one side to the other) with only 3 
vertices on one side [13]; moreover, even over the single tiny digraph -^3,3, the only 
solution available to-date is the one given below via n-fold integer programming. 

As usual, / and g denote the maximum absolute values of the objective functions 
/ and g over the feasible set. It is usually easy to determine an upper bound on 
these values from the problem data. For instance, in the special case of linear cost 
functions /, g, bounds which are polynomial in the binary-encoding length of the 
costs a e , 7g , capacities u, and demands d^, are easily obtained by Cramer's rule. 

We have the following theorem on (nonlinear) many-commodity transshipment. 

Theorem 2.6 [13] For every fixed digraph G there is an algorithm that, given I 
commodity types, demand d k v G Z for each commodity k and vertex v, edge capacities 
u e G Z +; and convex costs f e ,g^:Z^Z presented by evaluation oracles, solves in 
time polynomial in I and (d*,u e , f,g), the many- commodity transshipment problem, 

e \ \fe=l / k=l / 

I 

S.t. ^GZ, <~ E xk e=<%> E X e<«e, ^>0 . 

eeS+(v) eeS-(v) k=l 
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Proof. Assume G has s vertices and t edges and let D be its s x t vertex-edge 
incidence matrix. Let / : Z* — > Z and g : Z'* — > Z be the separable convex functions 

defined by f(y) := Y? e= i fe(y e ) with y e := Y! k =i x e and tffa) := E* e =i ELi 0* fa*)- 
Let l ) be the vector of variables with x k G Z* the flow of commodity 

k for each k. Then the problem can be rewritten in vector form as 

mini / (XX) + #(z) : x e Z lt , Dx k = d k , £V < u, x > 
[ \fe=i / k=i 

We can now proceed in two ways. 

First way: extend the vector of variables to ') with x° E Z* 

representing an additional slack commodity. Then the capacity constraints become 
X]fc = o x k = u and the cost function becomes f(u — xo) + g(x 1 , . . . , x l ) which is also 
separable convex. Now let A be the (t, s) x t bimatrix with first block A\ :— I t the 
t x t identity matrix and second block A 2 :— D. Let d° := Du — Y^k=\ d k an d let 
b := (u, d°, d 1 , . . . , d l ). Then the problem becomes the (/ + l)-fold integer program 

min {/ (u - x°) + g (x\ . . . , x l ) : x G Z {l+1)t , A (l) x = b , x > 0} . (2) 

By Theorem 1.2 this program can be solved in polynomial time as claimed. 

Second way: let A be the (0, s) x t bimatrix with first block A 1 empty and second 
block A 2 := D. Let W be the (t,0) x t bimatrix with first block W\ := I t the t x t 
identity matrix and second block W 2 empty. Let b := (d 1 , . . . , d l ). Then the problem 
is precisely the following /-fold integer program, 

min {/ (W {l) x) +g(x) : iGZ 11 , A {l) x = b , W {l) x < u , x > 0} . 

By Theorem 1.5 this program can be solved in polynomial time as claimed. □ 

We also point out the following immediate corollary of Theorem 2.6. 

Corollary 2.7 For any fixed s, the (convex) many- commodity transshipment prob- 
lem with variable I commodities on any s-vertex digraph is polynomial time solvable. 

2.2.2 The multicommodity transportation problem 

Here we consider the problem with fixed (but arbitrary) number / of commodities 
over any bipartite subdigraph of K m n (oriented from one side to the other) - the so- 
called multicommodity transportation problem - with fixed number m of suppliers 
and variable number n of consumers. This is very natural in operations research 
applications where few facilities serve many customers. The problem is difficult 
even for / = 2 commodities: deciding if a feasible 2-commodity transportation exists 
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(regardless of its cost) is NP-complete already over the complete bipartite digraphs 
Km,n [7]; moreover, even over the digraphs K$ n with only m = 3 suppliers, the only 
available solution to-date is the one given below via n-fold integer programming. 

This problem seems harder than the one discussed in the previous subsection 
(with no seeming analog for non bipartite digraphs), and the formulation below 
is more delicate. Therefore it is convenient to change the labeling of the data a 
little bit as follows (see Figure 4). We now denote edges by pairs where 



Multicommodity Transportation Problem 

Find integer I commodity transportation x of minimum f,g cost 
from m suppliers to n consumers in the bipartite digraph K m n 

Also given are supply and consumption vectors s 1 and d in Z 1 , 
edge capacities U| , and volume v k per unit commodity k 

consumers 




For suitable (ml,l)xrml bimatrix A and suitable (0,m)xrml bimatrix W 
derived from the v k the problem becomes the n-fold integer program 

min { f(W (n) x)+g(x) : x in Z nml , A (n) x =(s', d), W (n) x<u, x>0} 



Figure 4: Multicommodity Transportation Problem 

1 < % < m is a supplier and 1 < j < n is a consumer. The demand vectors are 
now replaced by (nonnegative) supply and consumption vectors: each supplier i has 
a supply vector s l G with s\ its supply in commodity k, and each consumer 
j has a consumption vector c J G Z' + with c? k its consumption in commodity k. 
In addition, here each commodity k may have its own volume Vf. G Z + per unit 
flow. A multicommodity transportation is now indexed ) with 
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xi = . . . , x{ ^ . . . , x J ml , . . . ,x J ml ), where x\ k is the flow of commodity k from 

supplier i to consumer j. The capacity constraint on edge is EL=i v k x i,k — u i,j 
and the cost is fa (ELi + ELi Si,k i x i,k) with fa^i,k '■ Z ~> Z convex. 

As before, /, <? denote the maximum absolute values of /, g over the feasible set. 

We assume below that the underlying digraph is K m ^ n (with edges oriented from 
suppliers to consumers), since the problem over any subdigraph G of K m>n reduces 
to that over K m n by simply forcing capacity on all edges not present in G. 

We have the following theorem on (nonlinear) multicommodity transportation. 

Theorem 2.8 [13] For any fixed I commodities, m suppliers, and volumes Vk, there 
is an algorithm that, given n, supplies and demands s\ c 7 G capacities Uij G Z +; 
and convex costs fij,g J ik '■ Z — > Z presented by evaluation oracles, solves in time 
polynomial in n and (s\c> ,u, f, g), the multicommodity transportation problem, 

min E fa \ H VkX lk + ZM* Kfc) 

i,j V V k / k=l / 

I 

s.t. x[ k G Z , ^ = 4 , E = 4 . E VkX U ^ ' 4fc ^ • 

j i fc=l 

Proof. Construct bimatrices A and W as follows. Let D be the (/, 0) x I bimatrix 
with first block D\ := // and second block D 2 empty. Let V be the (0, 1) x I 
bimatrix with first block V\ empty and second block V 2 := (v±, . . . , v{). Let A be 
the (ml, I) x ml bimatrix with first block Ai := I m i and second block A 2 :— D^ m \ 
Let W be the (0, m) x ml bimatrix with first block W\ empty and second block 
W 2 := V (m \ Let b be the (ml + n/)-vector b : = (s 1 , . . . , s m , c 1 , . . . , c n ). 

Let / : Z nm — > Z and g : Z nmi — > Z be the separable convex functions defined by 

/(y) : = J2ijfa(yid) with : = ELi^<it and 9(x) ■■= EijELi^fcK*)- 

Now note that is an (m/ + n/)-vector, whose first ml entries are the flows 

from each supplier of each commodity to all consumers, and whose last nl entries 
are the flows to each consumer of each commodity from all suppliers. Therefore the 
supply and consumption equations are encoded by A^x = b. Next note that the 
nm-vector y = (y 1A , . . . , y mA , ... , y hn , ... , y m>n ) satisfies y = W^x. So the capacity 
constraints become x < u and the cost function becomes f(WV>x) + g(x). 
Therefore, the problem is precisely the following n-fold integer program, 

min {/ (W (n) x) +g(x) : x G Z nml , A {n) x = b , W (n) x <u, x > 0} . 

By Theorem 1.5 this program can be solved in polynomial time as claimed. □ 
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3 Theory 

In §3.1 we define Graver bases of integer matrices and show that they can be used 
to solve linear and nonlinear integer programs in polynomial time. In §3.2 we show 
that Graver bases of n-fold products can be computed in polynomial time and, 
incorporating the results of §3.1, prove our Theorems 1.1-1.5 that establish the 
polynomial time solvability of linear and nonlinear n-fold integer programming. 

To simplify the presentation, and since the feasible set in most applications is 
finite or can be made finite by more careful modeling, whenever an algorithm detects 
that the feasible set is infinite, it simply stops. So, throughout our discussion, an 
algorithm is said to solve a (nonlinear) integer programming problem if it either finds 
an optimal solution x or concludes that the feasible set is infinite or empty. 

As noted in the introduction, any nonlinear function / involved is presented 
either by a mere comparison oracle that for any two vectors x, y can answer whether 
or not f(x) < f(y), or by an evaluation oracle that for any vector x can return f(x). 

3.1 Graver Bases and Nonlinear Integer Programming 

The Graver basis is a fundamental object in the theory of integer programming 
which was introduced by J. Graver already back in 1975 [11]. However, only very 
recently, in the series of papers [4, 5, 12], it was established that the Graver basis 
can be used to solve linear (as well as nonlinear) integer programming problems in 
polynomial time. In this subsection we describe these important new developments. 

3.1.1 Graver bases 

We begin with the definition of the Graver basis and some of its basic properties. 
Throughout this subsection let A be an integer m x n matrix. The lattice of A 
is the set C(A) := {x G Z n : Ax = 0} of integer vectors in its kernel. We use 
C*(A) := {x G Z n : Ax = 0, x ^ 0} to denote the set of nonzero elements in C{A). 
We use a partial order □ on IR n which extends the usual coordinate-wise partial 
order < on the nonnegative orthant W] and is defined as follows. For two vectors 
x, y G M. n we write x ^y and say that x is conformal to y if xiyi > and \xi\ < \yi\ 
for i — 1, . . . , n, that is, x and y lie in the same orthant of 1R™ and each component 
of x is bounded by the corresponding component of y in absolute value. A suitable 
extension of the classical lemma of Gordan [10] implies that every subset of Z n has 
finitely many □-minimal elements. We have the following fundamental definition. 

Definition 3.1 [11] The Graver basis of an integer matrix A is defined to be the 
finite set Q{A) C Z n of minimal elements in C*(A) = {x G Z n : Ax = 0, x ^ 0}. 
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Note that G{A) is centrally symmetric, that is, g G G(A) if and only if —g G G{A). 
For instance, the Graver basis of the 1x3 matrix A := [1 2 1] consists of 8 elements, 



Note also that the Graver basis may contain elements, such as (1,-1,1) in the 
above small example, whose support involves linearly dependent columns of A. So 
the cardinality of the Graver basis cannot be bounded in terms of m and n only and 
depends on the entries of A as well. Indeed, the Graver basis is typically exponential 
and cannot be written down, let alone computed, in polynomial time. But, as we 
will show in the next section, for ra-fold products it can be computed efficiently 

A finite sum u := Yli v i °f vectors in W 1 is called conformal if all summands lie 
in the same orthant and hence v j □ u for all i. We start with a simple lemma. 

Lemma 3.2 Any x G C*{A) is a conformal sum x = J2i9i °f Graver basis elements 
9i G G{A), with some elements possibly appearing more than once in the sum. 

Proof. We use induction on the well partial order C. Consider any x G C*(A). If it 
is □-minimal in C*(A) then x G G(A) by definition of the Graver basis and we are 
done. Otherwise, there is an element g G G(A) such that g C x. Set y := x — g. 
Then y G C*(A) and y E x, so by induction there is a conformal sum y = J2i9i 
with (yfj G £/(A) for all i. Now x = g + J2i 9i * s a conformal sum of x. □ 

We now provide a stronger form of Lemma 3.2 which basically follows from the 
integer analogs of Caratheodory's theorem established in [2] and [26]. 

Lemma 3.3 Any x G C*(A) is a conformal sum x = Yll=i ^i9i involving t < In — 2 
Graver basis elements g-i G G(A) with nonnegative integer coefficients Aj G Z + . 

Proof. We prove the slightly weaker bound t < 2n — 1 from [2]. A proof of the 
stronger bound can be found in [26]. Consider any x G £*(A) and let g±, . . . ,g s be 
all elements of G(A) lying in the same orthant as x. Consider the linear program 



By Lemma 3.2 the point a; is a nonnegative linear combination of the gi and hence 
the program (3) is feasible. Since all g« are nonzero and in the same orthant as x, 
program (3) is also bounded. As is well known, it then has a basic optimal solution, 
that is, an optimal solution Ai, . . . , \ s with at most n of the Aj nonzero. Let 



G(A) 



± {(2, -1, 0), (0, -1, 2), (1, 0, -1), (1, -1, 1)} 




(3) 




Shmuel Onn 



17 



If y = then x = ^2[Xi\gi is a conformal sum of at most n of the gi and we are 
done. Otherwise, y G C*{A) and y lies in the same orthant as x, and hence, by 
Lemma 3.2 again, y = Y^i=i^i9i with all Ui G Z + . Then x = XX/ 1 * + l_^d)#i an d 
hence, since the \ form an optimal solution to (3), we have XXa*» + L^d) — S -V 
Therefore — XX ^ ~ L^d) < n with the last inequality holding since at most 
n of the Aj are nonzero. Since the fa are integer, at most n — 1 of them are nonzero. 
So x = XX/ 1 * + l_^d)#» i s a conformal sum of x involving at most 2n — 1 of the Oj. □ 

The Graver basis also enables to check the fmiteness of a feasible integer program. 

Lemma 3.4 Let Q(A) be the Graver basis of matrix A and let l,u G Z£,. // i/iere 
zs some o G satisfying gi < whenever Ui < oo and g t > whenever U > — oo 

i/ien every sei o/ the form S := {x G Z™ : Ax = 6 , Z < x < -u} is either empty or 
infinite, whereas if there is no such g, then every set S of this form is finite. Clearly, 
the existence of such g can be checked in time polynomial in (Q(A),l,u). 

Proof. First suppose there exists such g. Consider any such S. Suppose S contains 
some point x. Then for all A G Z + we have I < x + \g < u and A(x + Xg) = Ax = b 
and hence x + Xg G S, so S is infinite. Next suppose S is infinite. Then the polyhe- 
dron P := {x G R n : Ax = b , I < x < u} is unbounded and hence, as is well known, 
has a recession vector, that is, a nonzero h, which we may assume to be integer, 
such that x + ah G P for all x G P and a > 0. This implies that h G £*(A) and 
that hi < whenever ttj < oo and hi > whenever /j > — oo. So /i is a conformal 
sum ft, = ^2 gi of vectors o« G each of which also satisfies o« < whenever 

Ui < oo and g« > whenever > — oo, providing such g. □ 



3.1.2 Separable convex integer minimization 

In this subsection we consider the following nonlinear integer minimization problem 

min{/(x) : x G Z n , Ax = b, I < x < u} , (4) 

where A is an integer m x n matrix, b G Z m , Z,w G Z^,, and / : Z n — > Z is a 
separable convex function, that is, /(x) = X]j=i fj( x j) w ith /j : Z — > Z a univariate 
convex function for all j. We prove a sequence of lemmas and then combine them to 
show that the Graver basis of A enables to solve this problem in polynomial time. 

We start with two simple lemmas about univariate convex functions. The first 
lemma establishes a certain supermodularity property of such functions. 
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i=l / i=l \ i=l 



m—1 

Si 
i=l 



Lemma 3.5 Let f : R — > R 6e a univariate convex function, let r be a real number, 
and let si, . . . ,s m be real numbers satisfying SiSj > /or a// i, j. Then we have 

_/(r) - ^ (/(r + Si) " /(r)) • 
i=i / i=i 

Proof. We use induction on m. The claim holding trivially for m — 1, consider 
m > 1. Since all nonzero Sj have the same sign, s m = A X^i s « f° r some < A < 1. 
Then 

(m \ m—1 / m 

r + E Si ) ' r + E s * = Ar + ~ A M r + E 

and so the convexity of / implies 

(m-l 
r +E 
i=i 

< (1 - A)/(r) + A/ |r + £ + A/(r) + (1 - A)/ (^ + E s 

i=i 

Subtracting 2f(r) from both sides and applying induction, we obtain, as claimed, 
^ + E S - /(r) 

(m-l \ 
r + E s j - 

m 

> E^ r + ^)-/( r )) • D 
i=i 

The second lemma shows that univariate convex functions can be minimized 
efficiently over an interval of integers using repeated bisections. 

Lemma 3.6 There is an algorithm that, given any two integer numbers r < s and 
any univariate convex function f : Z — ► R given by a comparison oracle, solves in 
time polynomial in (r, s) the following univariate integer minimization problem, 



Si 

i=i 



mm 



{/(A) : A G Z, r < A < s} 
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Proof. If r = s then A := r is optimal. Assume then r < s — 1. Consider the integers 



r < 


r + s 




r + s 




< 






2 




2 



Use the oracle of / to compare / ( ) and / ( [^J + l) ■ By the convexity of /: 

/ ([^ H = / (L^J + lj 4 A := L^J is a minimum of /; 

/ (L^J) < / (L^J + l) =^ the minimum of / is in the interval [r, [^Jli 

/ (L^J) > / (L^J + 1) =>• the minimum of / is in the interval [[^J + 1, s}. 

Thus, we either obtain the optimal point, or bisect the interval [r, s] and repeat. So 
in 0(log(s — r)) — 0({r, s)) bisections we find an optimal solution A e Z D [r, s]. □ 

The next two lemmas extend Lemmas 3.5 and 3.6. The first lemma shows the 
supermodularity of separable convex functions with respect to conformal sums. 

Lemma 3.7 Let f : IR n — > R be any separable convex function, let x <E M. n be any 
point, and let gi be any conformal sum in W 1 . Then the following inequality holds, 

+ > £(/(* + <*)-/(*)) . 

Proof. Let fj : R — > R be univariate convex functions such that f(x) = YTj=\ fj( x j)- 
Consider any 1 < j < n. Since ^ is a. conformal sum, we have gijgkj > for all 
i, k and so, setting r := Xj and Sj := g^j for all i, Lemma 3.5 applied to fj implies 

fj {^j + Y^9i^j ~ fj( x j) > (/j ( X J + - fj( x i)) ■ ( 5 ) 

Summing the equations (5) for j = 1, . . . , n, we obtain the claimed inequality. □ 

The second lemma concerns finding a best improvement step in a given direction. 

Lemma 3.8 There is an algorithm that, given bounds l,u e direction g e Z n ; 
pom£ x £ 7j n with I < x < u, and convex function f : Z ra — > R presented by 
comparison oracle, solves in time polynomial in (l,u,g,x), the univariate problem, 

min{/(x + Xg) : X E Z+ , I < x + Xg < u} (6) 

Proof. Let 5 := {A G Z + : / < x + Xg < u] be the feasible set and let s := supS, 
which is easy to determine. If s = oo then conclude that S is infinite and stop. 
Otherwise, S = {0, 1, . . . , s} and the problem can be solved by the algorithm of 



20 



N-Fold Integer Programming 



Lemma 3.6 minimizing the univariate convex function h(X) := h(x + Xg) over S. □ 

We can now show that the Graver basis of A allows to solve problem (4) in 
polynomial time, provided we are given an initial feasible point to start with. We 
will later show how to find such an initial point as well. As noted in the introduction, 
/ below denotes the maximum value of | / (x) | over the feasible set (which need not 
be part of the input). An outline of the algorithm is provided in Figure 5. 



Separable Convex Minimization Using Graver Bases 



R n 



R 




Solve: min{ f(x) : x in Z n : Ax = b, I < x < u} 



Given: the Graver basis G(A) 
and initial feasible point 



Algorithm: Iteratively greedily augment initial point 
to optimal one using elements from G(A) 



Supermodularity of f and integer Caratheodory's theorem assure 
polynomial convergence 



Figure 5: Separable Convex Minimization Using Graver Bases 



Lemma 3.9 There is an algorithm that, given an integer mxn matrix A, its Graver 
basis G(A), vectors l,u £ ZJ^ and x £ Z n with I < x < u, and separable convex 
function f : Z n — > Z presented by a comparison oracle, solves the integer program 



min{/(z) : z £ Z n , Az = b , I < z < u} , b := Ax , 



(7) 
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in time polynomial in the binary- encoding length (Q(A),l,u,x, f) of the data. 

Proof. First, apply the algorithm of Lemma 3.4 to Q(A) and l,u and either detect 
that the feasible set is infinite and stop, or conclude it is finite and continue. Next 
produce a sequence of feasible points xo,xi,. . . ,x s with xq := x the given input 
point, as follows. Having obtained Xk, solve the univariate minimization problem 

mm{f(x k + Xg) : A E Z + , g E Q{A) , I < x k + Xg < u } (8) 

by applying the algorithm of Lemma 3.8 for each g E G(A). If the minimal value in 
(8) satisfies f(x k + Xg) < f(xk) then set x k+ i '■= x k + Xg and repeat, else stop and 
output the last point x s in the sequence. Now, Axk+i = A(x k + Xg) = Axk = b by 
induction on k, so each x k is feasible. Since the feasible set is finite and the Xk have 
decreasing objective values and hence distinct, the algorithm terminates. 

We now show that the point x s output by the algorithm is optimal. Let x* be 
any optimal solution to (7). Consider any point x k in the sequence and suppose it 
is not optimal. We claim that a new point x k +i will be produced and will satisfy 

9n — 3 

f(x k+1 )-f(x*) < ^— 2 {f{x k )-f{x*)) (9) 

By Lemma 3.3, we can write the difference x* — Xk = Yll=i ^i9i as conformal sum 
involving 1 < t < 2n — 2 elements E Q{A) with all A; E Z + . By Lemma 3.7, 

f(x*)-f(xk) = f I Xk + ^Xigi J - f(x k ) > ^2(f(xk + Kgi)-f(xk)) ■ 

V i=i / i=i 

Adding t (f(x k ) — f(x*)) on both sides and rearranging terms we obtain 
t 

J2(f(x k + X igi )-f(x*)) < (t-l)(f(x k )-f(x*)) ■ 
i=i 

Therefore there is some summand on the left-hand side satisfying 

f(x k + X i9i )-f(x*) < tZ±(f( Xk )-f( x *)) < ^^(f( Xk )-f( x *)) . 

So the point x k + Xg attaining minimum in (8) satisfies 

2n — 3 

f(x k + Xg)-f(x*) < f( Xk + X i9i )-f(x*) < ——(f( Xk )-f( x *)) 

and so indeed x k +i '■= x k + Xg will be produced and will satisfy (9). This shows that 
the last point x s produced and output by the algorithm is indeed optimal. 
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We proceed to bound the number s of points. Consider any i < s and the 
intermediate non optimal point x^ in the sequence produced by the algorithm. Then 
f(xi) > f(x*) with both values integer, and so repeated use of (9) gives 

* (1^1)' <**>-/<*•)> 

and therefore 

4 - ( log l^f) (/(*)- /(**)) . 

Therefore the number s of points produced by the algorithm is at most one unit 
larger than this bound, and using a simple bound on the logarithm, we obtain 

s = 0(n\og(f(x)-f(x*))) . 

Thus, the number of points produced and the total running time are polynomial. □ 

Next we show that Lemma 3.9 can also be used to find an initial feasible point 
for the given integer program or assert that none exists in polynomial time. 

Lemma 3.10 There is an algorithm that, given integer m x n matrix A, its Graver 
basis Q(A), l,u G Z^,, and b G Z m 7 either finds an x G Z™ satisfying I < x <u and 
Ax = b or asserts that none exists, in time which is polynomial in (A,Q(A),l,u,b) . 

Proof. Assume that / < u and that U < oo and Uj > — oo for all j, since otherwise 
there is no feasible point. Also assume that there is no g G Q(A) satisfying ^ < 
whenever U{ < oo and gi > whenever U > — oo, since otherwise S is empty or 
infinite by Lemma 3.4. Now, either detect there is no integer solution to the system 
of equations Ax = b (without the lower and upper bound constraints) and stop, or 
determine some such solution x G Z n and continue; it is well known that this can be 
done in polynomial time, say, using the Hermite normal form of A, see [25]. Next 
define a separable convex function on Z™ by f(x) := YTj=i fj( x j) with 

{lj — Xj , if Xj < lj 
0, if lj <Xj <Uj , j = l,...,n 

X j U j . if X j ^ > U'j 

and extended lower and upper bounds 

lj := mm{lj,Xj}, Uj := max{uj, Xj} , j — l,...,n. 
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Consider the auxiliary separable convex integer program 

min{/(z) : z E Z n , Az = b , I < z < u] (10) 

First note that lj > — oo if and only if lj > — oo and Uj < oo if and only if Uj < oo. 
Therefore there is no g E satisfying g { < whenever ttj < oo and ^ > 

whenever U > — oo and hence the feasible set of (10) is finite by Lemma 3.4. Next 
note that x is feasible in (10). Now apply the algorithm of Lemma 3.9 to (10) and 
obtain an optimal solution x. Note that this can be done in polynomial time since 
the binary length of x and therefore also of I, u and of the maximum value / of 
\f(x)\ over the feasible set of (10) are polynomial in the length of the data. 

Now note that every point z E S is feasible in (10), and every point z feasi- 
ble in (10) satisfies f(z) > with equality if and only if z G S. So, if f(x) > 
then the original set S is empty, whereas if f(x) — then x G S is a feasible point. □ 

We are finally in position, using Lemmas 3.9 and 3.10, to show that the Graver 
basis allows to solve the nonlinear integer program (4) in polynomial time. As usual, 
/ is the maximum of \f(x)\ over the feasible set and need not be part of the input. 

Theorem 3.11 [12] There is an algorithm that, given integer m x n matrix A, its 
Graver basis Q{A), l,u G b G 7L m , and separable convex f : Z™ — > Z presented 
by comparison oracle, solves in time polynomial in (A,Q(A),l,u,b, f) the problem 

min{/(x) : x Ell 1 , Ax = b , I < x < u} . 

Proof. First, apply the polynomial time algorithm of Lemma 3.10 and either con- 
clude that the feasible set is infinite or empty and stop, or obtain an initial feasible 
point and continue. Next, apply the polynomial time algorithm of Lemma 3.9 and 
either conclude that the feasible set is infinite or obtain an optimal solution. □ 



3.1.3 Specializations and extensions 

Linear integer programming 

Any linear function wx = Yll=i w % x i is separable convex. Moreover, an upper bound 
on \wx\ over the feasible set (when finite), which is polynomial in the binary-encoding 
length of the data, readily follows from Cramer's rule. Therefore we obtain, as an 
immediate special case of Theorem 3.11, the following important result, asserting 
that Graver bases enable the polynomial time solution of linear integer programming. 
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Theorem 3.12 [4] There is an algorithm that, given an integer m x n matrix A, 
its Graver basis Q{A), l,u G b G Z m , and w G Z n 7 solves in time which is 
polynomial in (A, G(A), I, u, b, w), the following linear integer programming problem, 

min{wx : x G Z n , Ax = b , I < x < u} . 
Distance minimization 

Another useful special case of Theorem 3.11 which is natural in various applications 
such as image processing, tomography, communication, and error correcting codes, 
is the following result, which asserts that the Graver basis enables to determine a 
feasible point which is / p -closest to a given desired goal point in polynomial time. 

Theorem 3.13 [12] There is an algorithm that, given integer m x n matrix A, its 
Graver basis Q{A), positive integer p, vectors l,u G Z^, b G Z m ; and x G Z n ; solves 
in time polynomial in p and (A,Q(A),l,u,b,x), the distance minimization problem 

min {\\x — x\\ p : x G Z™, Ax — b, I < x < u} . (11) 

For p = oo the problem (11) can be solved in time polynomial in (A,Q(A),l,u,b,x). 

Proof. For finite p apply the algorithm of Theorem 3.11 taking / to be the p-th 
power \\x — x\\p of the l p distance. If the feasible set is nonempty and finite (else the 

algorithm stops) then the maximum value / of \f(x)\ over it is polynomial in p and 
(A, I, u, b, x), and hence an optimal solution can be found in polynomial time. 

Consider p = oo. Using Cramer's rule it is easy to compute an integer p with 
(p) polynomially bounded in (A, l,u, b) that, if the feasible set is finite, provides an 
upper bound on ||a;||oo for any feasible x . Let q be a positive integer satisfying 

logn 

q > log(l + (2p)-i) • 

Now apply the algorithm of the first paragraph above for the l q distance. Assuming 
the feasible set is nonempty and finite (else the algorithm stops) let x* be the feasible 
point which minimizes the l q distance to x obtained by the algorithm. We claim 
that it also minimizes the distance to x and hence is the desired optimal solution. 
Consider any feasible point x. By standard inequalities between the and l q norms, 

I I ,->-» ^ ry* I I I I / >■ I I <^ I I />> rfi I I <^ q I I iy /y I I 

| | | | OO | | tjO tAj | | q - | | iAj tAj | | q _^ / 1/ ^ || JU JU | | • 

Therefore 

\\x* - x||oo - \\x - £||oo < (n~i - l)\\x - xWoo < (n« - l)2p < 1, 
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where the last inequality holds by the choice of q. Since — £||oo and \\x — x\\oo 
are integers we find that \\x* — < \\x — £||oo- This establishes the claim. □ 

In particular, for all positive p G Z^, using the Graver basis we can solve 
min{||x|| p : x G Z n , Ax = b, I < x < u] , 
which for p = oo is equivalent to the min-max integer program 

min {max{|a;j| : i — 1, . . . , n) : x G Z n , Ax = b, I < x < u} . 

Convex integer maximization 

We proceed to discuss the maximization of a convex function over of the composite 
form f(Wx), with / : Z d — > Z any convex function and W any integer dxn matrix. 

We need a result of [23]. A linear- optimization oracle for a set S C Z n is one 
that, given w G Z™, solves the linear optimization problem maxjwj; : x G 5}. A 
direction of an edge (1-dimensional face) e of a polyhedron P is any nonzero scalar 
multiple of u — v where u, v are any two distinct points in e. A set of all edge- 
directions of P is one that contains some direction of each edge of P, see Figure 6. 

Theorem 3.14 [23] For all fixed d there is an algorithm that, given a finite set 
S C Z n presented by linear- optimization oracle, integer dxn matrix W , set E C Z n 
of all edge-directions of conv(S') , and convex f : Z d — > R presented by comparison 
oracle, solves in time polynomial in (maxdlrrHoo : x G 5}, FY, E 1 ), the convex problem 

max {f(Wx) : x e S} . 

We now show that, fortunately enough, the Graver basis of a matrix A is a set of 
all edge-directions of the integer hull related to the integer program defined by A. 

Lemma 3.15 For every integer mxn matrix A, l,u G Z^ 7 and b G Z m ; £/ie Graver 
basis Q{A) is a set of all edge- directions of Pi := convja; G Z™ : Ac = 6, I <x < u}. 

Proof. Consider any edge e of Pj and pick two distinct integer points x, y G e. Then 
g := y — x is in C*(A) and hence Lemma 3.2 implies that (7 = ^ f /ij is a conformal 
sum for suitable /ij G ^(^4). We claim that rr + hi G Pj for all i. Indeed, /ij G G(A) 
implies A(x + /ij) = Ax = b, and / < x, x + g < u and hi ^ g imply I < x + hi < u. 

Now let u> G Z n be uniquely maximized over Pj at the edge e. Then w/ij = 
w(x + hi) — wx < for all i. But J^whi = wg = wy — wx = 0, implying that 
in fact whi = and hence x + hi G e for all i. This implies that fa, is a direction 
of e (in fact, all hi are the same and g is a multiple of some Graver basis element). □ 

Using Theorems 3.12 and 3.14 and Lemma 3.15 we obtain the following theorem. 
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Edge-Directions of a Convex Polytope 




Figure 6: Edge-Directions of a Convex Polytope 

Theorem 3.16 [5] For every fixed d there is an algorithm that, given integer mxn 
matrix A, its Graver basis Q{A), l,u G Z£, ; b G Z m , integer d x n matrix W, and 
convex function f : 7/ — > R presented by a comparison oracle, solves in time which 
is polynomial in (A, W, Q(A), l,u, b), the convex integer maximization problem 

m&xifiWx) : x G Z n , Ax = b, I < x < u} . 

Proof. Let S := {x G Z n : Aa; = 6 , Z < a; < u}. The algorithm of Theorem 3.12 al- 
lows to simulate in polynomial time a linear-optimization oracle for S. In particular, 
it allows to either conclude that S is infinite and stop or conclude that it is finite, 
in which case (max{||rp|| ao : x G S}) is polynomial in (A, l,u, b), and continue. By 
Lemma 3.15, the given Graver basis is a set of all edge-directions of conv(S') = Pj. 
Hence the algorithm of Theorem 3.14 can be applied, and provides the polynomial 
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time solution of the convex integer maximization program. □ 



3.2 N-Fold Integer Programming 

In this subsection we focus our attention on (nonlinear) n-fold integer programming. 
In §3.2.1 we study Graver bases of n-fold products of integer bimatrices and show 
that they can be computed in polynomial time. In §3.2.2 we combine the results 
of §3.1 and §3.2.1, and prove our Theorems 1.1-1.5, which establish the polynomial 
time solvability of linear and nonlinear n-fold integer programming. 

3.2.1 Graver bases of n-fold products 

Let A be a fixed integer (r, s) x t bimatrix with blocks Ai, A 2 . For each positive 
integer n we index vectors in Z rat as x = (x 1 , . . . , x n ) with each brick x k lying in Z*. 
The type of vector x is the number type(a;) := \{k : x k ^ 0}| of nonzero bricks of x. 
The following definition plays an important role in the sequel. 

Definition 3.17 [24] The Graver complexity of an integer bimatrix A is defined as 

g{A) := inf {g E Z+ : type(x) < g for all x E Q(A^) and all n) . 

We proceed to establish a result of [24] and its extension in [16] which show that, 
in fact, the Graver complexity of every integer bimatrix A is finite. 

Consider n-fold products A^ of A. By definition of the n-fold product, A^x = 
if and only if A 1 J2k=i ^ k = and A 2 x k = for all k. In particular, a necessary 
condition for x to lie in C(A^), and in particular in Q{A^>), is that x k E C(A 2 ) for 
all k. Call a vector x = (x 1 , . . . ,x n ) full if, in fact, x k E C*(A 2 ) for all k, in which 
case type(x) = n, and pure if, moreover, x k E Q{A 2 ) for all k. Full vectors, and in 
particular pure vectors, are natural candidates for lying in the Graver basis Q(A^) 
of A^ n \ and will indeed play an important role in its construction. 

Consider any full vector y — (y 1 , . . . , y m ). By definition, each brick of y satisfies 
y % E C*{A 2 ) and is therefore a conformal sum y % = Yl^i^ 1 ^ °f some elements 
x 1 ^ E G{A 2 ) for all i,j. Let n := k\ + • • • + k m > m and let x be the pure vector 

rr _ iV 1 T n ~\ ■— (r 1 ' 1 t 1 ^ 1 t" 1 ' 1 ^ m ^ k m\ 

JU \JU j • • • j tXj J . \tXj j ... j JU j ... j Jb j . . . j JU J . 

We call the pure vector x an expansion of the full vector y, and we call the full vector 
y a compression of the pure vector x. Note that A\ y l = A\ x 1 ^ and therefore 
y E C^A^) if and only if x E C(A^). Note also that each full y may have many 
different expansions and each pure x may have many different compressions. 
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Lemma 3.18 Consider any fully = (y 1 , . . . , y m ) and any expansion x = (x 1 , . . . , x n ) 
of y. If y is in the Graver basis Q(A^) then x is in the Graver basis Q(A^). 

Proof. Let x = (x 1,1 , . . . , x m,km ) = (x 1 , . . . , x n ) be an expansion of y = (y 1 , . . . , y m ) 
with y i = Y,%i xi ' j for each *■ Suppose indirectly y E g^A^) but x Q{A^). 
Since y E C*(A^) we have x E C*(A^). Since x £ G(A^), there exists an element 
g = (g 1 ' 1 , . . . ^g m > k ™) in Q(A^) satisfying g C x. Let h — (h 1 ,..., h m ) be the com- 
pression of g defined by h l := Yl'jLi fi fM ■ Since g E C*(A^) we have h E C*(A^). 
But h \Z y, contradicting y E Q(A^). This completes the proof. □ 

Lemma 3.19 The Graver complexity g(A) of every integer bimatrix A is finite. 

Proof. We need to bound the type of any element in the Graver basis of the /-fold 
product of A for any I. Suppose there is an element z of type m in some Q(A^). 
Then its restriction y = (y 1 , . . . ,y m ) to its m nonzero bricks is a full vector and 
is in the Graver basis Q{A^ n ">). Let x = (x 1 , . . . ,x n ) be any expansion of y. Then 
type(z) = m < n = type(a;), and by Lemma 3.18, the pure vector x is in Q(A^). 

Therefore, it suffices to bound the type of any pure element in the Graver basis 
of the n-fold product of A for any n. Suppose x = (x 1 , . . . ,x n ) is a pure element 
in Q(A^) for some n. Let Q(A 2 ) = {g 1 , ■ ■ ■ ,g p } be the Graver basis of A 2 and let 
G 2 be the t x p matrix whose columns are the g l . Let v E 1?+ be the vector with 
Vi := \{k : x k = g l }\ counting the number of bricks of x which are equal to g l for 
each %. Then Y^=i v i = type(x) = n. Now, note that A\G 2 v = A\ Y^k=i x k = and 
hence v E £*(AiG 2 ). We claim that, moreover, v is in Q(AiG 2 ). Suppose indirectly 
it is not. Then there is a -0 E ^(A 1 G ? 2 ) with v C v, and it is easy to obtain a nonzero 
x n. x from x by zeroing out some bricks so that Vi = \{k : x k = g l }\ for alH. Then 
A i ELi £fc = A i G 2V = and hence 5 e C*{A^), contradicting x E Q(A^). 

So the type of any pure vector, and hence the Graver complexity of A, is at most 
the largest value Y%=i v i °f an y nonnegative vector v in the Graver basis Q(AiG 2 ). □ 

We proceed to establish the following theorem from [4] which asserts that Graver 
bases of n-fold products can be computed in polynomial time. An n-lifting of a vector 
y — (y 1 , . . . , y m ) consisting of m bricks is any vector z — (z 1 , . . . , z n ) consisting of n 
bricks such that for some 1 < k\ < ■ ■ ■ < k m < n we have z ki = y % for % — 1, . . . , m, 
and all other bricks of z are zero; in particular, n > m and type (z) = type(y). 

Theorem 3.20 [4] For every fixed integer bimatrix A there is an algorithm that, 
given positive integer n, computes the Graver basis Q(A^) of the n-fold product of 
A, in time which is polynomial in n. In particular, the cardinality \Q{A^)\ and the 
binary- encoding length (Q(A^)) of the Graver basis of A^ are polynomial in n. 
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Proof. Let g := g{A) be the Graver complexity of A. Since A is fixed, so is g. 



Consider any n-lifting z of any y G G(A^). Suppose indirectly z ^ Q(A^). Then 
there exists z' G Q{A^) with z' C -2. But then z' is the n-lifting of some y' G 
C*(AW) with y' c y, contradicting y G <?(AW). So 2 G £(A (ri) ). 

Conversely, consider any z G (/(A'")). Then type(z) < g and hence 2 is the 
n-lifting of some y G C*(A^). Suppose indirectly y Q(A^). Then there exists 
y' G Q(A^) with y' C y. But then the n-lifting 2' of y' satisfies z' G £*(A (n) ) with 
c 2, contradicting 2 G £(A (ri) ). So y G 

Now, the number of n-liftings of each y G (/(A^)) is at most ( n ), and hence 



So the set of all n-liftings of vectors in Q(A^) and hence the Graver basis Q(A^) 
of the n-fold product can be computed in time polynomial in n as claimed. □ 

3.2.2 N-fold integer programming in polynomial time 

Combining Theorem 3.20 and the results of §3.1 we now obtain Theorems 1.1-1.4. 

Theorem 1.1 [4] For each fixed integer (r, s) x t bimatrix A, there is an algorithm 
that, given positive integer n, l,u G ZJ^ ; b G Z r+ns , and w G Z nt , solves in time 
which is polynomial in n and (/, u, b, w), the following linear n-fold integer program, 



Proof. Compute the Graver basis Q(A^) using the algorithm of Theorem 3.20. Now 
apply the algorithm of Theorem 3.12 with this Graver basis and solve the problem. □ 

Theorem 1.2 [12] For each fixed integer (r, s) x t bimatrix A, there is an algorithm 
that, given n, l,u G 17^, b G Z r+ns , and separable convex f : Z nt — > Z presented by 
a comparison oracle, solves in time polynomial in n and (l,u,b,f), the program 





min {wx : x G Z nt , A {n) x = b, I < x < u) . 



mm 



{fix) 



: xeZ nt , A (n) x = b, l<x<u) . 



30 



N-Fold Integer Programming 



Proof. Compute the Graver basis Q(A^) using the algorithm of Theorem 3.20. Now 
apply the algorithm of Theorem 3.11 with this Graver basis and solve the problem. □ 

Theorem 1.3 [12] For each fixed integer (r, s) x t bimatrix A, there is an algorithm 
that, given positive integers n and p, l,u G Z^ 7 b G Z r+ns , and x G Z nt , solves in 
time polynomial in n, p, and (I, u, b, x) , the following distance minimization program, 

min{||x-x|| p : x G Z nt , A {n) x = b, I < x < u} . (12) 

For p = oo the problem (12) can be solved in time polynomial in n and (l,u,b,x). 

Proof. Compute the Graver basis Q(A^) using the algorithm of Theorem 3.20. Now 
apply the algorithm of Theorem 3.13 with this Graver basis and solve the problem. □ 

Theorem 1.4 [5] For each fixed d and (r,s) x t integer bimatrix A, there is an 
algorithm that, given n, bounds l,u G Z^ ; integer d x nt matrix W, b G Z r+ns , 
and convex function f : Z d — > K. presented by a comparison oracle, solves in time 
polynomial in n and (W,l,u,b), the convex n-fold integer maximization program 

max{f(Wx) : x G Z nt , A {n) x = b, I < x < u} . 

Proof. Compute the Graver basis Q(A^) using the algorithm of Theorem 3.20. Now 
apply the algorithm of Theorem 3. 16 with this Graver basis and solve the problem. □ 

3.2.3 Weighted separable convex integer minimization 

We proceed to establish Theorem 1.5 which is a broad extension of Theorem 1.2 
that allows the objective function to include a composite term of the form f(Wx), 
where / : Z d — > Z is a separable convex function and W is an integer matrix with 
d rows, and to incorporate inequalities on Wx. We begin with two lemmas. As 
before, f,g denote the maximum values of \g(x)\ over the feasible set. 

Lemma 3.21 There is an algorithm that, given an integer m x n matrix A, an 
integer d x n matrix W, l,u G Z^ 7 I, it G Z^,, b G 7h m , the Graver basis Q{B) of 

B := ( W / ) ' 

and separable convex functions f : Z d — > Z ; g : Z n — > Z presented by evaluation 
oracles, solves in time polynomial in (A, W, G(B), I, u, I, it, b, /, g) , the problem 

min{/(Wx) + g(x) : x e Z n , Ax = b , l<Wx<u, I < x < u} . (13) 
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Proof. Define h : Z n+d -> Z by h(x,y) := f(-y) + g(x) for all x G Z n and y e Z d . 
Clearly, h is separable convex since f,g are. Now, problem (13) can be rewritten as 

mm{h(x,y) : (x,y) G Z"+ rf , ( £ j)^) = (o),Z<x<«,-«<y<-Z>, 

and the statement follows at once by applying Theorem 3.11 to this problem. □ 



Lemma 3.22 For every fixed integer (r, s) x t bimatrix A and (p, q)xt bimatrix W , 
there is an algorithm that, given any positive integer n, computes in time polynomial 
in n, the Graver basis Q(B) of the following (r + ns + p + nq) x (nt + p + nq) matrix, 

_ ( \ 

~ \ I J ■ 

Proof. Let D be the (r + p, s + q) x (t + p + q) bimatrix whose blocks are defined by 
. (A, \ / A 2 \ 

Apply the algorithm of Theorem 3.20 and compute in polynomial time the Graver 
basis Q(D^) of the n-fold product of D, which is the following matrix: 



/ A x 
Wi I p 


A x 
Wi I p 




A 1 \ 
Ip 


A 2 
w 2 /, 
















A 2 
W 2 J, 

















\ 








A 2 

^2 J, / 



Suitable row and column permutations applied to give the following matrix: 



C := 



( A1 


Ai • 


• A 1 





•• 


• 





• 


• \ 


A 2 
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• 





•• 


• 
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• 





A 2 • 


• 





•• 


• 
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• 
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• A 2 





•• 


• 
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Wi 


Wi ■ 


■ Wi 


Ip 


Ip ■■ 


• Ip 
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• 


w 2 
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■ 





•• 
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I q 
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• 





w 2 • 
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•• 
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h ■ 
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V o 
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• w 2 





•• 
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I J 
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Obtain the Graver basis G(C) in polynomial time from Q(D^) by permuting the 
entries of each element of the latter by the permutation of the columns of Q(D^) 
that is used to get C (the permutation of the rows does not affect the Graver basis). 

Now, note that the matrix B can be obtained from C by dropping all but the first 
p columns in the second block. Consider any element in G(C), indexed, according to 
the block structure, as (x 1 , x 2 , . . . , x n , y x ,y 2 , . . . , y n , z 1 , z 2 , . . . , z n ). Clearly, if y k = 
for k — 2, . . . , n then the restriction (x 1 , x 2 , . . . , x n , y 1 , z 1 , z 2 , . . . , z n ) of this element 
is in the Graver basis of B. On the other hand, if (x 1 , x 2 , . . . , x n , y 1 , z 1 , z 2 , . . . , z n ) 
is any element in G(B) then its extension (x 1 , x 2 , . . . , x n , y 1 , 0, . . . , 0, z 1 , z 2 , . . . , z n ) 
is clearly in G(C). So the Graver basis of B can be obtained in polynomial time by 

G{B) := {(x\...,x n ,y\z\...,z n ) : (x\ . . . , x n , y\ 0, . . . , 0, z\ . . . , z n ) G Q{C)} . 

This completes the proof. □ 

Theorem 1.5 [13] For each fixed integer (r, s) x t bimatrix A and integer (p, q) xt 
bimatrix W , there is an algorithm that, given n, l,u e 72^, l,u G TP^ nq , b G Z r+ns , 
and separable convex functions f : Z p+nq — > Z, g : Z n * — > Z presented by evaluation 
oracles, solves in time polynomial in n and (/, u, I, it, b, /, i/ie generalized program 



mm 




n) a;) + : x G Z n * , A (ri) a: = b , f < W^ (n) a; < u , / < x < m} 



Proof. Use the algorithm of Lemma 3.22 to compute the Graver basis G(B) of 

_ ( A^ \ 

~ { ww i J ■ 

Now apply the algorithm of Lemma 3.21 and solve the nonlinear integer program. □ 



4 Discussion 

We conclude with a short discussion of the universality of n-fold integer programming 
and the Graver complexity of (directed) graphs, a new important invariant which 
controls the complexity of our multiway table and multicommodity flow applications. 

4.1 Universality of N-Fold Integer Programming 

Let us introduce the following notation. For an integer sxi matrix D, let BD 
denote the (t, s) xt bimatrix whose first block is the txt identity matrix and whose 
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second block is D. Consider the following special form of the n-fold product, defined 
for a matrix D, by := (BD)^ n \ We consider such m-fold products of the 1x3 
matrix I3 := [1, 1, 1]. Note that if™' is precisely the (3 + m) x 3m incidence matrix 
of the complete bipartite graph K 3 m . For instance, for m — 3, it is the matrix 

/100100100\ 
1 1 1 
[3] 1 1 1 

3 ~ 111000000 
1 1 1 
\ 1 1 1 / 

We can now rewrite Theorem 2.1 in the following compact and elegant form. 

The Universality Theorem [7] Every rational polytope {y G : Ay = b} stands 
in polynomial time computable integer preserving bijection with some polytope 

{^R}" : l [ ™ ][n] x = a} . (14) 



The bijection constructed by the algorithm of this theorem is, moreover, a simple 
projection from M_ 3mn to M d that erases all but some d coordinates (see [7]). For 
% — 1, . . . , d let x a u\ be the coordinate of x that is mapped to yi under this projection. 
Then any linear or nonlinear integer program min{/(y) : y G Z+, Ay = b} can be 
lifted in polynomial time to the following integer program over a simple {0, l}-valued 
matrix l!™ - "™' which is completely determined by two parameters m and n only, 

min {/ (x a{1) , . . .,x a[d) ) : x G Z 3 + mn , lf ][n] x = a] . (15) 

This also shows the universality of n-fold integer programming: every linear or 
nonlinear integer program is equivalent to an n-fold integer program over some 
bimatrix Ell 3 which is completely determined by a single parameter m. 

Moreover, for every fixed m, program (15) can be solved in polynomial time for 
linear forms and broad classes of convex and concave functions by Theorems 1.1-1.5. 

4.2 Graver Complexity of Graphs and Digraphs 

The significance of the following new (di)-graph invariant will be explained below. 

Definition 4.1 [1] The Graver complexity of a graph or a digraph G is the Graver 
complexity g(G) := g(BD) of the bimatrix BD with D the incidence matrix of G. 
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One major task done by our algorithms for linear and nonlinear n-fold integer 
programming over a bimatrix A is the construction of the Graver basis Q(A^) in 
time O (n 9 ^) with g(A) the Graver complexity of A (see proof of Theorem 3.20). 

Since the bimatrix underlying the universal n-fold integer program (15) is pre- 
cisely 3D with D = lg 71 ' the incidence matrix of K^ m , it follows that the complexity 
of computing the relevant Graver bases for this program for fixed m and variable n 
is O (n g<yKi ' m ^ where g(K 3j7n ) is the Graver complexity of K 3:Tn as just defined. 

Turning to the many-commodity transshipment problem over a digraph G dis- 
cussed in §2.2.1, the bimatrix underlying the n-fold integer program (2) in the proof 
of Theorem 2.6 is precisely 3D with D the incidence matrix of G, and so it fol- 
lows that the complexity of computing the relevant Graver bases for this program 
is O (n 9 ^) where g(G) is the Graver complexity of the digraph G as just defined. 

So the Graver complexity of a (di)-graph controls the complexity of computing 
the Graver bases of the relevant n-fold integer programs, and hence its significance. 

Unfortunately, our present understanding of the Graver complexity of (di)-graphs 
is very limited and much more study is required. Very little is known even for the 
complete bipartite graphs K^ m : while g(K 3t3 ) = 9, already g(K 3 ^) is unknown. See 
[1] for more details and a lower bound on g{K 3m ) which is exponential in m. 
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